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ABSTRACT 

This guide is part of a series designed to assist 
school personnel to profile their data to support local school 
decisions. The profiling process can be used in school improvement 
programs. This particular guide describes the measurement of student 
attitudes toward schooling, about one's schools performance, about 
feelings toward school as a place to learn, or about others' 
judgments of one's school performance. Criteria for attitude test 
selection are outlined, including test validity, community standards 
of appropriateness, provision of information by tie test publisher, 
norms, age appropriateness, score reports, and instructions for 
interpretation. Planning of the data collection is recommended. 
Testing should occur within a week of the achievement testing, if 
attitudes and achievement are to be compared. Decisions must be made 
about who to test, whether the responses need be anonymous, 
additional biographicrl information needed, and scoring procedures. 
Standard procedures nould be used for administering tests and 
recording data. Pro ;odures for reporting and interpreting the data 
are illustrated, using Scott Foresman's School Attitude Measure a. c > an 
example. Suggestions for evaluating the findings and developing grals 
are included. (GDC) 
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The School Profiling Guide: 
Attitude Measurement 



INTRODUCTION 



This guide is the second in a series designed to assist school personnel to profile their 
data to support local school decisions. The profiling process is being used bv manv 
schools and districts as a tool for school improvement An example of a school " 
improvement process that includes school profiling is the Onward to Excellence 
program of the Northwest Regional Educational Laboratory (NWREL). The Onward 
imnrn C vi™!S P ro F a . m s * res ? es ™ ongoing cycle of developing school profiles, setting 
improvement goals, developing prescriptions or implementation objectives, monitoring 
progress and developing school profiles. J ' monuorin S 

Profiling calls for staff members such as a school improvement team to 

identify appropriate profiling measures, collect the data, prepare the profile, state the 

findings, interpret the findings and set improvement goals. This process is outlined 



THE PROFILING PROCESS 

1. PLANNING THE PROFILE 

2. PLANNING THE DATA COLLECTION 

3. COLLECTING THE DATA 

4. PREPARING THE DATA TABLES 

5. REPORTING THE RESULTS 

6. DEVELOPING NARRATIVE STATEMENTS 

7. EVALUATING THE FINDINGS 

8. DEVELOPING GOALS 



This guide describes the profiling process using measures of student attitude. Student 
attitude measures are affective factors that have been increasingly recognized as 
2 i? e ?<£S 1 Vj f h f teaching and learning process (Bloom, 1976, Walberg, 1974, Brookover 
et aL 1967). Walberg's (1974) comment is illustrative: "If the school is to be successful in 
influencing a person s behavior after he has completed his formal education then the 
development of positive affective responses toward learning and school-related skills is 
oi major importance (p. 99). 

The effective schools movement has identified three characteristics of effective 
learnn g climates: (1) ideology of the school (e.g. general beliefs, norms, feeiir.es which 
characterize the system); (2) organization of the school and (3) instructional practices 
(Brookover, et. aL, 1967). r 
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The import of this depiction is that effective schools have students who believe that 
school is a place to learn and brieve, in their ability to learn. In con trast when 
students feel out of control in relationship to the learning process they lower their 
expectations and perform accordingly. How children feel about their school 'eachers 
and themselves as learners is an important outcome in itself as well as an aid to 
understanding other school outcomes. 



1. PLANNING THE PROFILE 



. .n planning the profile of school outcomes there are many choices. Deciding what to 
look at andhjow to look at school outcomes are two essential features of the proflfe 
planning. Thas guide focuses on the profiling of attitudes as an important feature in 
describing educational outcomes. 

Before moving on to the various formats for presenting the data, an explanation of the 
role of student attitudes as a profiling outcome will be presented. Information on will 
be provided on why we study student attitudes concerning school, how attitude 
measures are different frpm other measures, whose attitudes should be measured and 
what we can infey from the findings. Following this will be some background on 
measuring attituoes including the selection of instruments. Finally, we will discuss 
planning the data collection, collecting the data and portraying the results. Each of 
these points presents questions that should be answered in planning the school profile. 

What is an attitude? 

Most of us are familiar with the three aspects of our humanness: thinking, feeling and 
acting. We measure thinking through achievement tests, actions through behavioral 
observations and feelings through attitude measurement. Our measuring capacity has 
been fairly well developed for measuring achievement skills and behaviors. Measuring 
our feelings, however, has generally lacked credibility as a concept and as a valid 
school measure of school effectiveness. Our feelings are viewed as more private 
intangible, more transitory in both focus and intensity. 

Attitudes have been described as feelings of a positive or negative nature toward an 
external or internal object. Thus, examples of statements that reflect attitude are "I 
like schoo , Doing well in math will lead to a well paying job," 'The study of math 
develops oiscipline and so on. Exiernal objects can be thl school, courses of study 
other students in general or in particular, the teachers, principal or education. Inierna] 
Objecti are primarily the self. Concepts such as self-esteem, self-worth or self-c oncept 
refer to the collection of teelings about one's performance or reactions to an 
environment 



For purposes of planning the profile, it may be very important to develop a working 
definition of attitude and ?ts use in the school profiling process. There are those 
who finely distinguish between attitude, belief, value and opinion. There are those who 
distinguish feelings toward external objects from the feelings toward the self The 
definitional emphasis and focus should balance the need for relevant information on 
student attitudes toward school with the privacy or non-disclosure concerns of student-; 
and families that could emerge when attitude testing includes items covering self- 
esteem or general values or beliefs. 6 
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For our purposes we define these attitudes as a collection of evaluative predispositions 
based on direct or indirect experience, toward schooling, about one's schod p£%r1Z£Zoia 
perSornZfe. * * pl "* 10 ^ or *°" ^ments ofln?s 7hof 

Why study student attitude concerning school? 

Only recently have those interested in school accountability encouraeed measuring 
student attitudes as an important consequence of education. In addition Su 
important outcome of the educational process, they believe that how one feels lout 
schooling and one's ability to interact iK the schooling p?o^a£f<Si™hScil 
behaviors and school achievement. Thus, attitudes art an end-or outcome-of an 
educational program and a means-or explanation-to otheTmeasured outcomes 

The inclusion of an attitude measure in the school profile allows you to: 

o examine the results of school objectives aimed at change in attitudes about 
school (e.g., confidence building, sense of achievement, positive peer rllations, 

o compare student attitudes over time 

o compare school level scores with other schools, and national norms 
o explain changes in achievement scores 

o explain changes in school behaviors (e.g, attendance, tardiness) 
° ^^SSST* V3ri0US SUbgr ° U P S in achievement., behavior or 
o examine student reactions to new curriculum, programs, facilities, etc. 
This information allows school personnel to make more informed decisions reearrimo 
s S ch h o°o 0 ! a P ctiev e :rnen P t raCtlCeS ^ ^ affcct Student attitudeS cSe^XS SP* 

How is measuring school attitudes different from measuring achievement or behavior? 

M k a , S, t remen { of ach ievement has a long history and there is general acceptance of 
what kinds of questions represent cognitive growth and development Th? 
measurement of behaviors is deemed important to the education™ process and include, 
counts of behavioral occurrences such as absences, tardiness and so on Attitude 
measurement is more difficult because we must Mfix the attitude f?L rtatSSiti or 
behavior. Many times what is said and the accompanying behaviors d? not se?m to 
correspond. For example, a student may report that he "Rkes school" but is constant] v 
fighting on the playground, late to class or absent entirely. In this case " the seated ' 
feeling and behaviors seem to contradict. ' 

c S h. d ,M tS oftentimes respond to questions posed to them in the way that they think thev 

^UvSw^v^JJ!;^ the V eaI] y feeI ' T h.is is described as 
SJSSS Stu t den s know they are to provide the "correct" answer to an 
achievement test They often transfer that pattern to an attitude test Additionally a 
student may not interpret a question the wa P y it was inttnM?J^£^SS^nt 
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may respond affirmatively that he "likes school" - even though he does not like school 

hi, J2J *m h fl v dl n l3S ; 7™' S ° he ? elS he ,g^ erall y ' "kes school." His other behavio 
this year may reflect his current dissatisfaction, yet he has misunderstood the 
instructions to respond to his present feelings. This is much less of a problem with the 
cognitive skill questions. FU "" cni vvun xnc 

This lack of congruence between observed behavior and responses on a test 
or responding in a socially desirable way are each threats to the validity of the test 
instrument; that is, whether the test instrument is measuring w hat it is supposed to 
measure. A test of school related attitudes should measure tL studentVfeeW 
C A°t n t 9 t er 5 ing Sch ° o1 not attltudes viewed by the student as desirable or "acceptable." 
reliability. 11 ntS ' U ° 0ntraSt ! ° achievement instruments, have lower validity and 

Reliability refers to the instrument measuring the same thing over time Thus 
consistency or the ability to get the same score if the test were to be repeated is 
important. An achievement instrument that would produce widely fluctuating scores 
SnsSencv^n ?h it b ? f uL S , imilarly ' an attl ' ude instrument must ^STiSne 

^:z^rS hut h suffers from definitional specific " ty and — 

What characteristics of attitude should you measure? 

Si 1 ii mpo i tan , t t0 knoW the cnaract eristics of attitude you wish to measure as you 
reduL Jr^ l ° P 3n instrument ' . For exa ^ple, if the goal of the school program "s to 
reduce racial or economic prejudices, then a measure of inter-group attitudes would be 

3£ ^S2Su« of sel S1T C W .H e K imereSted in general s "em of the students' 
men a measure oi selt-esteem would be appropriate. 

Beyond the general goals for the use of an attitude measure is the determination of the 
n?X°c f rin e . inS t tr T ent - l h0uld th u e ^rumem look at attitudes toward ^specific aspect, 
e tc' O -)hou Id T Z^u 35 math ' th f ^lingual program, new teachers, ?he princfpaK 
fn eeneraP crhn V * 0n m ,° re g )° bal attltud « toward school in genera/, teacfers 

in general? Some school personnel prefer to know how the students feel about the 
specific aspects of schooling so they can work on those areas where they feel there are 

as a learnt T&'SfF*? l -° S 0W ° nly P neral attitudeS toward school or the student 
as a learner The difficulty in the generafapproach is that the school staff have less t0 

go on to make changes. A student with a distaste for a particular teacher or particular^ 
S r P r e ,i m H y nu P ° rt ¥ ga J IV „ c a u ttitudes toward sch0 °l on questions about schoof fn 

f^^^i&SSSL about specific courses or " some,, teachers > more p° sitive 

How do you measure attitudes? 

?f n m.I?nr gener f 1 ? PP J?l Ch J* ^ ocus of the testin & has be en determined, then the type 
objective ftSES iSS U ~ H declded " Tests ° f attitude ™nge from those that are more 
StS2i WKES. *t?? '\ l res P onses , to questions) to those that are subjective (behavior 
[nk bfotsj ' gS ' J0Urnals ) t0 tnose tnat are more projective (sociometry, 

For purposes of the school profile, two methods are suggested, paper and pencil tests 
and behavioral rating scales. Of these, the paper and pencil tests are easiest to 
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administer since it takes the least amount of time, and requires less inference 
instrume r m° r y ° UDger studcnts » 3 well ' d esigned behavior Observation could be a better 



Whose attitudes should be measured? 



k? a • n tlVe SCh °? S concludes that school climate or school attitudes arc 
influenced by and influence students, teachers, school staff and parents 
Teachers expectations of students, their views of themselves as teachers their suDDort 
from their superiors and their resources to do the job, all influence Ik "they app??ach 
the classroom situation. Should the profile include teacher attitudes? approacn 

out'nTcrh^^fttn^ 6 eVeD m °5 e P° w " ful in some wses. We know students who drop 
out of school often have parents who dropped out of school Do Darent attitudes 
toward the value of school play a part in fie student's .tSSdS ' ¥ he fntrXcdon of 
new programs such as busing or mainstreaming may produce strong attitudes o?ac?on^ 
™? ar f? tS ; K 3rental at !, itud es toward school policies such as homework or detention 
SSJdS? ^ StUdCntS V1CW SUCh P0lici&> Should the P rofile iSwre ?SSS 

The focus of education, however, is on the student. Measuring student attitudes will 
reflect how the students feel. In order to fully understand student att tudes we mav 
want to measure how parents, teachers and school staff feel. " Iluu «, v>e ma> 

Should you use existing or locally-developed measures? 

fl n Jtl the measurement of attitudes does not have the history of achievement testing 
there are fewer "industry standards" than with achievement tests. While there are not 
common or widely-used attitude tests, still, there is no paucity it instrument Manv 

s s ;sr nts ' owever ' were deveioped for ° ther p^iSs« wfth" 

Sfcrt^-n^Sl!? 6 3 teS A°K r d6Ve f 1 ? P your own ins trument depends on school 

quest or that askl KEn*^?* 1 ? A f V6ry Simple attitude ™ easure could b * one 
Question tnat asks students, On a scale of one to ten, with ten being verv positive hnu- 

do you feel about this school?" You might find out that 60 percent of the stud ems rSiri 

the school 8 or better, while 40 percent of the students ra~f it "b than 2 We can 

nu^hlff ' m ° St ° f ^ "P*™ ^ ^ P° Sitive ab ° Ut this SChoSl, but a good 

number fee very negative. Are these students at risk of dropping out* Are these 
students doing well academically? Further examination of tKwer rating students 
may suggest either to focus on particular students or programs. g StUdents 

Whether one question or several, a locally-developed test can measure more closelv 
what you wish to measure, can be more brief, eas&r to score and cheaper than a test 
purchased from a publisher. Over time the answers to specific questions and the fndex 
of questions may prove to provide the nuances of chang? that are viewed as more 

^tV^rl^t?* diffi ^ UltieS ^^-te ^a m u°r r es in 
achievement " £2 tw w£ comm,:ttee w ?Y Id encounter if they made up the 
fSlS ? ♦ • The re would be no norms with which to compare the school scores no 

so o t ^wouIdhTvlJn th f \ COreS ' n ° eiimina ^n of redundant measures and ° 
so on. You would have to field test the instrument to ensure that the reading levels 

wi^T?nd,m d .iH e StUd6 T S Ullderst °° d the intent of the questions u\ he 
fSf/ to understand general opinion or attitudes toward schooling and learning a 
locally-developed instrument may 6e appropriate. For example, in measuring pareltal 
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attitude towards the school or program changes, a locally-develoDed survev *ith hnti, 
be bJ ne!pful: nd 3ttltUde qU6Sti ° nS ma >' be ™- appropriate. The ffi kwSg con tra s t ma y 

locally Peveloped Tpsts PnM isher BgV£lQB^ 



Advantages Cost 

Brevity 



Norms provided 
Assistance with 



Specific Focus interpretation 

Standardization 
Disadvantages Interpretation problems Higher cost 

SSSS'iJSS?— with Time dela * s in 

What are some criteria for test selection? 

SSfrf!" S f VCral sour £ es listed in the references of this guide that offer reviews of 
nntin de , inSt ' UmentS - Coi ? mitt " members should develop guidelines and re view 
potential instruments so that they reflect the interests and goals of the 
profiling process. The following questions should be asked fbout each instrument: 

° Pn^erestlJ ifmTa^in°g? US °" ^ dCfiniti ° n ° r f ° CUS ° f attitude that we are 
o Do the questions measure what we are interested in (face validity)? 
o Does the instrument measure global attitudes or specific attitudes? 

o Will the focus of the questions be deemed appropriate by parents and 
community members? v uj parents ana 

° 2.°t~ h - e X T P u W!*er provide information on validity and how it was 
determined; on reliability and how it was determined? 

° £°ouVs^ and norms for all of interest? How was the norm 

normed? y students were tested? What time of year was the test 

o Are the items suitably worded for the indicated age groups? 

° 2o?es? re SC ° reS presented? Can a total ^hool score be obtained? Grade level 

° iW^n 0 /? 1 gI " 9Up com P lete < he test on an anonymous basis. Does the 
instrument require anonymity? i«c 

o Are there clear instructions for interpreting the results? 
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2. PLANNING THE DATA COLLECTION 

Once the committee has decided on the focus of the attitude testing and has selected or 
developed their own measure (and field-tested it), then the data collection should be 
P i a *u ne J ♦ ,, 1S a ? g *jreroely important aspect of the profiling process. The planning 
of the data collection determines the breadth of information that can be presented It 
is during the planning for data collection that the information beyond the test scores 
and the methods for summarizing and analyzing the data are determined. 

When should you test? 

? n ct u r s ,;S t at V£ ud ! measure for the school profiling process, it is important to give the 
instrument to the students within a week or so of the achievement testing if attitude 
will be compared to achievement test scores and relationships are to be dFawn If 
attitude affects achievement and vice versa, then both attitude and achievement 
measurement should occur as reasonably close together as possible. 

^^ a »tt?tnSr^ ent tests J 3rese " t norms T b . ased on fall, winter or spring testing, so do 
some attitude measures. Some do not. It is important to know when the test was 
normed. As the school year progresses it is expected that both general and 
specific attitudes may change. If a locally developed instrument is used then 
administering it at the same time of the year will be important to the reliability of 
subsequent analyses. »s«auim) ui 

Who should be included? 

i^S^tl^H^r^ Wh3t gr °u PS ?J?°K Uld be tested ' e -S" teachers, students, parents, 
it is important to decide how many should be tested within each school. If vou 
are generating a school profile is it necessary to test all students in all grades'* The 
answer will be determined by the goals of the profiling process and the time and 
resources of the school. Even though achievement testing may not be undertaken in 
every grade, the information from each grade on the amtu^ Instruments may be very 
helpful in understanding the developmental nature oflcho^l attitudes and 
tfteir relationship to behavior, subgroup identification and the like. 

Should the responses be anonymous? 

h^Lnvmnu^T^-^ tha l y ° U will , examine will suggest that the students' responses 
be anonymous. This is done for several reasons. Among them are the assumption that 
he students will be more honest and teachers will not be able to penalize stents for 
their answers. y «»iuuwi»ioi 

Whether students are more "honest" in their reporting when the testing is anonymous is 
open to some debate. Some students are known to provide wild guessef or outrageous 
responses because they are not identified with the responses. Wfiatever the reasons for 
anonymity, it the test is anonymous, it is important to the planning that information 
for further analysis be collected with the attitude testing. These items will include 
information desired to further explain the testing results. An anonymous attitude test 
may include such demographic information as age, grade, sex, and as much information 
as deemed appropriate. Unless the information Ts collected from the students at The 
time of testing, later subgroup analysis is impossible. 



ERIC 



1 f 



8 



What other subgroup information is needed? 

While the school profile, focuses on schoolwide results, it is important to plan what 
nl^iIJi n" 1S . desired in order to more fully explain tne profile. For example, 
one school profile could show the results of the eighth grade testing with the average 
percentile score on an achievement test as 62nd percentile and the average uercentile 

nr°' e v? n thC a ^ tltude te - St ar ' ^ th u P ercent ^ Information from the ■ £3 "deleFoper mav 
provide some interpretive insights on both scores but the profile would provide little 
other information urn ss that information had been collected for further analysis. 

In general, educators wish to determine differences between students in different 

SSffJSKJ 'JESS™?* s P ec + iall y f unded or experimental projects, or those influenced bv 
differing curriculum or teaching methods. Sometimes differences between girls and ' 
mTsfp^ 9 " 1 * 10 su t b F 0U P s > eth "ic subgroups or language subgroups are of interest. It 
may be of interest to note student mobility, teacher tenure or achievement influence* 

\hlt 22 «J2 IS Tf a S° lu Jfl y necessar >' t0 identif >' ahead of time the related information 
that you need If the attitude tests are anonymous, there is no way to gather 
information later. If they are not anonymous, gathering the information 1: tc: will be 
time-consuming. 

If this is the first school profile, we suggest that the committee select a few levels for 
further analysis. The school profiling process is not intended as a fishing expedition 

i^S^^S^i^^ Pr0CCSS 15 C ° mp,eted ' sueeestions for subsequent year 



Should you score the instruments yourself? 



A final issue to resolve is how you will score the instruments. If the test is locallv- 

IftheTe'st is'frn^^li li aVe , t0 SC °^ theinstrume nts or seek a scoring service bureau. 
11 the test is from a test developer, there is usually an option for teacher scored or test 
developer scored. Some attitude tests are extremely difficult to score because 
the questions are phrased to reduce their social desirability. Using a test scoring service 
adds cost and time to the process but provides accuracy and precision 

3. COLLECTING THE DATA 

Most test administrators are aware of the necessity to follow the test publisher's 
instructions with great care when presenting the test materials to the students. The 
same degree of attention is needed for the administration of attitude test instruments 
How you present the attitude testing to students and the proper recording of the data 
are essential to your profiling techniques. K 

How should you present this to students? 

Jj.lt i£l^. n /« t ?k ,et t i? e S , tag ?,l or the att j* ude test > particularly if this is the first time 
that students in the school will be responding to this type of instrument. The teacher 
should either read the instructions provided by the test maker if it is a test provided t> v 
a publisher or explain the testing rationale and procedure of locally-developed 
tests All teachers need to agree on the importance of the test and comply with a 
standard procedure. r 
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How can you ensure that the demographic data is recorded correctly? 

Careful attention to the presentation of the instructions for completing the instrument 
and providing the required information for the analysis is essential. If the instrument 

nst r ul P P nt 0V Tf • t thC M ? ieS K 0 student ?' then the name must clearly ai^a • o the 
instrument. If the instrument is being provided anonymously, then the additional 

?,^nt a c tl0 A n t rCq! i^ ed for u Iater "5^. should be gone over item by Vem with the 
students. At each item, the test administrator should ask if there are Questions 
concerning that item. A good practice is for the test administrator to walk around the 
room while identifying the information that the students need to complete. 

m°ak?n^ the tC „ St adm j nistrat or should go over the instruments 

mamng sure the miormation is clear and complete. 

4. PREPARING THE DATA TABLES 

£ c n e ' h t e data are collec ; ed '.they must be recorded for reporting and interpretation. In 
the next severa pages of this guide we will be illustrating the process with examples 

g2t S lt 0 ' n A H tmUd£ M ? S " u (SAM j' 3 test develop^ by Scott, Foreman Sd 
Company 1980 and now available through American Testronix. The SAM is a norm- 

MSSt^t^iSSS^^ dCSigned t0 CXamine SCVeral "o- of "tud°ent 

r,«t Sca l e A : M oti Y ation fpf Schooling measures the effect of students' reactions to their 
past school experience and their relation to motivation in school. The value of school 
its desirability and importance are aspects of this measure. ' 

Scale B: Academic Self Concept ■ Pe rformance Rased reflects student confidence in 
their academic abilities and their feelings about their school 1 performance 

n thtr? l ft£ ^ cad f mic , Se ! f Concept ■ .Referent P.c.d fnp„... on how stu dents think 
s 0 uSce"d (t S 1661 ab -t the students' performance and ability to 

f^S a Jc C ? Student's Sense pf Control Over Performance i s concerned with students' 
£h Sf f I. bein & able \° ex ^cise control over situations that affect them at school 
and to take responsibility for the outcome of events such as grades or promotions 

Scale E: Student's Instructional Mastery reflects the students' report of their actual 
s ch0 .° skills? Included are their assessment of their ability to use time wisely 
persistence m instructional tasks and the like. w»ciy, 

?evef 7^^edVt\ V f 1S ft°v, f ^^SAM: Level AS rated at a fourth grade reading level. 
Level 7-8 rated at a fifth-sixth grade reading level and Level 9-12 rated at a seventh- 
SSfeft*™? readin S leveL Student scores are presented by Weighted Raw Score 

SEfr We? 1 P er ? entile W a ° d local percentile (if a/schSof Tin the district are 
tested). Scores are also presented by classroom and grade. 

The test w'as standardized in the fall of 1979 using 28,000 students from both Dublic and 
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In addition for our illustration, a locally-developed test was made up to give to 

n e A C tnH r P S ntT^ e I e •° h ? r TeS i c ° nsi , sted Pf as king the teachers to estimate the percentage 
of students in their class who feel positive about each of the scales in the SAM The 
descriptions of the SAM scales were provided with a place to give their Istimaie. 

FampF/sch^ iUUStratiVC inStrUCtiVC - Th6 >' arC refleCtive of 

How do you tabulate the data? 

SkIS.^ °?i! y !i W ° u et !? od 5 for ^bulating the data-by hand and by computer. 

r/roriln^Tf t by h u nd Ca \ be n , me c ? nsumin g and subject to errors in coding and 

avan a b?e g 'it JESSR t e num . b - er ° f StudentS '! sma11 and computer equipment is not 
available, it is probably the most inexpensive and practical. 

For hand tabulations, forms should be developed that will allow you to sort the 
responses by the categories you predetermined in the planning process. Figure 1 is an 

,h a e mP h le t°h tW ° t3lly S ^ CtS - The Scores > P rovided b ? & Publfsher, are plated on the 
sheet by the corresponding category. When all of the scopes are placed Tby the 

av^ge 11316 Categ ° ry ' they are tota ' ed and divided b y the numbed of scores to get the 

Figure 1 

Tally Sheets for School Attitude Measure 



Fifth 
Boys 




Scale A 


Scale B 


Scale 


C Seal© n 


Scale E 




42,43, 
36,45, 


48,45, 
41,48, 


34,38, 
33,44, 


42,41, 
36,50, 


51,50, 
48,53, 




12 


>>,.., 
Ave=45.5 


Ave=4 0 . 2 


>>,.., 

Ave= . . . 


••#••# 
Ave=. . . 


»»,.., 

Ave= . . . 


Fifth 
Girls 




31,45, 
29,36, 


65,50, 
41,45, 


45,50, 
37,54, 


40, 33, 
39,52, 


46,43, 
34,48, 




37 


.«,.., 
Ave=4 7.2 


Ave=. . . 


Ave= . . . 


Ave-. . . 


Ave= . . . 


Fifth 

Hi Mobility 


21,23, 
9, 22, 


28,13, 
ly,ll, 


33,45, 
22,31, 


31,28, 
18,14, 


25,31, 
11,9, 




25 


Ave= . . . 


Ave= . . . 


• o , • • , 

Ave=. . . 


Ave= . . . 


Ave= — 


Fifth 

Lo Mobility 


53,65, 
71,48, 


64,41, 
53,45, 


48,55, 
61,76, 


71,45, 
66,65, 


56,66, 
53,53, 




47 


Ave= . . . 


Ave= . . o 


Ave=. . 


. Ave= . . . 


Ave= . . . 



?tfc a ^c?ti a ^ la t tion ref u lects placine each score more than once on the tally sheet. 
Categories * the CSSential featUrC ° f discoveri ^ relationships among the 
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Hand tabulation has one major drawback. Each score is placed more than once on the 
tally sheet. The individual results must be repeatedly tabulated when identifying each 
student by the several categories. In Figure 1, a student who is a boy and who 
just moved to the district would have each scale's percentile entered two times While 
this cross-tabulation is an essential feature for discovering relationships among the 
categories, one can easily see that adding categories and students could make 
hand tabulation an undue burden. An alternative is to enter all of the information on 
a personal computer or on a mainframe computer. For personal com outers, there are 
several programs that provide relatively easy data entry, table presentation and graph 



presentation 
How should you present the data tables? 



Presenting the data in tables is always a judgment choice. Most people do not readily 
interpret data presented in a table, particularly if there are a lot of numbers presented 
If you desire to present tables in the text, it may be a good idea to present no more than 
four categories in each table. Table 1 is an example of the data presented on 
the subscales of the SAM for each grade. 



Table 1 

Fifth, Sixth and Seventh Grade Results 
School Attitude Measure 
Weighted Raw Score Average 





Scale A 


Scale B 


Scale C 


Scale D 


Scale 


E 




Fifth 


45 


39 


39 


43 


43 


N 


=62 


Sixth 


46 


40 


40 


45 


46 


N 


=58 


Seventh 


50 


44 


43 


47 


46 


N 


=121 



I ca£ i 18 a . de . scn P tlon of each grade's average raw score on each subscale 
of the SAM. It is descriptive for each grade. It is also comparative in that it includes 
more than one grade. Yea will note that with raw scores comparisons can be made bv 
grade level for each scale but not within grade level from scale to scale. This 
comparison is done when the scores are converted to percentiles. 

Table 2 

Fifth, Sixth and Seventh Grade Results 
School A f titude Measure 
National * ercentile Scores 





Scale A 


Scale B 


Scale C 


Scale D 


Scale 


E 




Fifth 


44% 


40% 


46% 


50% 


42% 


N 


=62 


Sixth 


49% 


46% 


53% 


50% 


62% 


N 


=58 


Seventh 


40% 


40% 


35% 


38% 


44% 


N 


=12: 
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Another way to present the data is to provide the percentage of students from the 
norm group who had this score or lower. The SAltf describls this as the NatSnal 
Percentile Rank. Table 2 presents the National Percentile of the average of the raw 
C s v ;^ ch 8™df : The data from the Tables 1 and 2 could be presented together, 

JSdS iS^SSnJ 0 ^ nU K m ^l which COuld confuse rather than cnlifhtcS he 
reader. The committee will have both the average Raw Score and the 

National Percentile Since the percentile score is commonly presented in both 

S ar«nh . Cnt 0ther "J™* be the best choice for Presentation. If you choose 
£KS& c sev , eral .S e K aSUreS ° n th f same ? ra P h ' achievement and attitude, using a 
common scale will be necessary for clarity and understanding. 

iifnr^^n^xK 1 , 6 ? re P° rt t the dat ? S ased on addit ional demographic or subgroup 
information. Table 3 presents one of these alternatives. 

Table 3 

Fifth Grade Results 
National Percentile Ranks for Boys and Girls 



Scale A Scale B Scale c scale n Scale E 

B °^ S 49% 47% 46% 50% 42% N=12 

Girls 55% 55% 52% 44% 54% N=37 



^wl i l v needed in recording whether the fifth grader was a boy or girl 
ESSSr 5 u 2 indlCate ^at there were 62 fifth graders wfio took the test, yet Sores 
identified by sex are available for only 49 students as presented in Table 3 

For many people, the table presentation will not be as easy to understand as 
fheTn n fn a ri° a n ti U n" g u C a P hi - c P resent ations are planned, the tables from which 

5. REPORTING THE RESULTS 

?nmn S nn P g n f t r0m ti he m ^ P otential wa y s of presenting the data will be an important 
component of the profi hng process. What you chooseto present will guide the 
conclusions, interpretation, and, perhaps, even future actfcn . Prev ewing and 
presenting the results will be discussed reviewing ana 

How do you preview the results? 

Previewing the results will follow closely the planning for data collection Data should 

• 6 gr . ade . l6Vel for the school, I nd broken down by subgroups 

In fnJCfl? °^ thlS actlv , lt >'.i s to determine the important or distinguishing g P 
and r^rls at e fl rW^?P 1C ' } f y S U J? ad d ™ d * d look at the differences between boys 
fulfill? £ 8 ♦ an i? the results indicat ed that the differences seemed ' 

insignificant, then presenting that data table or graph would just take up space A 
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What are the most important presentations? 

Many attitude instruments offer individual scores and guidance for interpretation 
Since we are concerned with the school profiling process, we encourage the reader' to 
consult the administrator's guide included with the attitude instrument or other texts 
cited in the references of the guide for information concerning individual 
interpretation. Individual interpretation, of course, would not be available if students 
responded anonymously. 

In presenting the data from your school it will be helpful first to describe the school, its 
location its economic or ethnic representation, types of programs and so on. Table 
4 presents the information from our Sample School. 

Table 4 

School Characteristics 
Sample School 1985-6 

Community: Lower economic industrial area near large city 

School Characteristics: Facility 22 years old; renovated 6 
years ago 

Students at each grade level: 

1 2345678 
25 31 58 63 62 58 121 118 

Sex ratio: 51% girls; 49% boys 

SES: Upper 8% 
Middle 53% 
Lower 39% 

K- ability : 
(4th grade and up) 



Teacher Mobility; 



New this year 


21% 


Completed 1 yr 


18% 


2 yrs 


17% 


3 yrs 


19% 


4 yrs 


25% 


New this year 


25% 


Completed l yr 


5% 


2 yrs 


5% 


3 yrs 


10% 


4 yrs+ 


55% 



It is important to note that data are often not useful unless they are compared with 
some other data or information. This process of comparison allows interpretation The 
following types of comparisons are discussed: analysis in relationship to norms; analysis 
over time; analysis by subgroups and analysis with other measures 
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Analysis in rela tionship t o norm groups. 

In standardized tests, the test publisher will provide the information on the norm 
group, e.g. how many, demographic characteristics and the like. The test publisher trie* 
to obtain a representative group at each grade level. Schools are selected tc be 
representative of the various regions of the country, reflecting variation in size of the 
district, urban/rural composition, socioeconomic status, and ethnic composition In 
many instances, norms or data within each of these areas are not offered Rather 

2p2 m nH!fHpH e m tK e assurin S representation, e.g. that rural, urban and suburban areas 
were included in the norm group. 

In comparing the school to a national norm group, the mean score of the grade is 
considered the average score of that group. The mean score can be translated to a 
percentile rank. That is, the average score of a group of students at the 58th percentile 
means that the average student in this class has a more positive attitude than 58 percent 
of the nationa sample. Figure 2 presents data from Table 2 displaying the fifth 
grade percentile ranks for each of the scales of the SAM. Figure 3 presents all three 

£r3GCS, 

Figure 2 
FIFTH GRADE RESULTS 




SCALE A 



SCALE B SCALE C SCALE 0 

School Attitude Measure 



SCALE E 



While the information in Figure 3 includes information from Figure 2, very different 
statements can be made about the two figures. In Figure 2, the focus would be on the 
fifth grade and the norm group. Narrative statements would focus on the 
relative standing of the fifth grade. 
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Figure 3 

sample: school results 




SCALE A SCALE B SCALE C SCALE D 

School Attitude Measure 



SCALE E 



?V?i! rC P resents L the audience an opportunity not only to compare the results of th P 
fifth graders to the norm group, but also to tfiie sixth and seventh graded ^ Questions 
such as Do attitudes improve toward schooling as students ge P old!r^Are there 
particular scales that have greater improvement, less improvement 

s^hoofdlstric'? "ft^?"^™* man y time ? Publishers present norms from the local 
and \th X2 J ' com t P anson / of results can be made to the local group of school 

naSonW focaf ^fe^ST" dat ' fr0m ,,An ° ther Sch ° o1 " Where b " h 

Figure 4 

ANOTHER SCHOOL FIFTH GRADE 

LOCAL AND NATIONAL NORMS 




8 



NATIONAL 



LOCAL 
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SCALE A SCALE B SCALE C SCALE D SCALE E 

School Attitude Measure 
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"Another School," Somewhere, USA, represents a more affluent suburban district In 
this figure the students' average percentile rank is high compared to the national" norm<= 
and low compared to the district scores 




Table 5 

Recording Student Results in Quartiles 



Students scoring 


Tally 


Total 


Percent of 
Total 


Between 




1 and 25 percentile 


flHIII 
• • • 


21 


34% 


26 and 50 percentile 


rrw rmi 

• • • • 


19 


31% 


51 and 75 percentile 


• • 


13 


21% 


75 and 100 percentile 


mum 

• • » • 


9 


15% 



Analysis over time 



Analysis over time provides an opportunity to note changes in school attitude in the 
same students. This is different from comparing the fifth grade this year to the sixth 
or seventh Teachers are familiar with the fact that certain grades are more positive or 
negative than others; there is a grade "culture." Figure 5 presents data from "Sample 

?o£°™ Whe £ • l £ e SAM was glven to the fifth g ra3e in !983 and subsequently through 
1985. Thus, this figure presents the same students over three years. This figure portrays 
data for only one scale of the SAM, the Motivation for School,^ B H } 
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Figure 5 

1983 FIFTH GRADE COHORT 

MOTIVATION FOR SCHOOLING 




1983 



1985 



1984 

School Attitude Measure 

Generally when you want to show trends over time it is convenient to use a line graph 
Line graphs leave the impression that there is a continuous relationship P 

dl ?P la >' e d ' can P°l e . the difference between the bar graph shown in Figure 5 
and the line graph shown in Figure 6. ^iguic j 



Figure 6 



90 
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1983 FIFTH GRADE COHORT 

MOTIVATION FOR SCHOOUNG 



0TH 



1983 1984 

School Attitude Measure 



TTH 



1985 
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Analysis hy subgroups 

Following your data analysis planning, you will want to present the data bv various 
subgroups. Figure 7 presents data from Table 3. You can note the visual advantage of 
the graphic presentation. B 
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Figure 7 
FIFTH GRADE RESULTS 

Scores for Boyt and Girls 



GRL5 




SCALE A SCALE B SCALE C SCALED 

School Attitude Measure 



SCALE E 



gliders 8 illuStrates g ra P hicall y the differences between low and high income fifth 



Figure 8 
FIFTH GRADE RESULTS 

Children From Low and High Income Homes 




fcsj LOW INCOUE 



Ml INCOME 



SCALE A SCALE B SCALE C SCALED SCALE E 

School Attitude Measure 

Since the Sample School had a number of students moving in and out, comparisons 
results mobility and low mobility students. Figure 9 depicts these 
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Figure 9 
FIFTH GRADE RESULTS 

LO AND HI MOBILITY STUDENTS 




£2 w UOSIUTY 
LO MOBHJTY 



SCALE A SCALES SCALE C SCALED SCALE E 

School Attitude Measure 

Analysis with other measures 

Finally, in the planning for the profile, the Sample School committee determined that 
results of the SAM and the results of the SAM with the results of the Metrooolitan 
Fi^u'rVS ,eSt « iven the « fth ^ These r « ults « V^SStS 

Figure 10 



STUDENT RESULTS AND TEACHER ESTIMATES 

SENSE OF CONTROL OVER PERF 




STUDENT 
TEACHER 



5TH 



6TH 77H STH 

School Attitude Measure 
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Figure 11 

STUDENT RESULTS AND TEACHER ESTIMATES 

SENSE OF CONTROL OVER PERF 




5TH 



6TH 



TTH 



STH 



6. DEVELOPING NARRATIVE STATEMENTS 

JMSSSSoT 8 ° f *" eaHi " P reSen « ati <™ «««» 2 " Presented again with 

Figure 2 
FIFTH GRADE RESULTS 

90* 
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o Students in this fifth grade scored at the national percentile average on Scale D 
student's Sense of Control Over Performance. S 

o Students scored lower than the national average in Motivation For Schooling 
(Scale A); Academic Self Concept-performance Based (Scale B); Academic Self 
Concept-Reference Based (Scale C> and Students' Instructional Mastery (Scale E). 

o Students scored the lowest in comparison to national averages on the scale that 
measures their perception of their ability to do tasks competently (Scale B). 

Figure 11 is presented with narrative statements: 

Figure 11 

STUDENT SAM AND STUDENT MAT 

SENSE OF CONTROL OVER PERF 



90- 




80- 




70- 




60- 




Percentlle 

— n 1 




30- 
20- 




10- 

o-l— 


8 



SAW 
UAT 



•1 




5TH 




6TH 



7TH 



BTH 



o While students scored lower than average compared to national percentiles on 
their sense of control over performance, they scored above average on the 
achievement test (MAT). 

o The discrepancy between sense of control over performance and achievement is 
the greatest at the seventh grade. 

o The sixth to seventh grade decline on the measure of control over performance 
is reversed in the eighth grade. 

You will note that some of the narrative statements presented above could be 
presented in other figures as well. There will be some redundancy when for 
comparison purposes information is presented on more than one graph. 
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7. EVALUATING THE FINDINGS 

The next step in the profiling process is for the profiling team to rate the narrative 
statements along two dimensions- These are an tf-point scale on satisfaction^ result 
and a five-point scale on relative importance. There is a great deal of give and take as 
the team members try to reach agreement on these ratings for each statement 

s I atS^rn S ?rl°cnw nk ° f ^ statemen i s as falling along a two dimensional space with 
S«iJ c \° f Z e ? uh i°^ dimensi °n and relative importance another. The faculty at 
Sample School" listed nine statements, A through I. Each were rated on the 

on m the S £?H °T£ tI i? a ? I 7 l °- f r > UltS and im P ortance - The statements were then placed 
on the grid. The highest priority statements were rated high importance and low 

Schoor' 1011 - gUrC 12 P ° rtrayS thC P lacement for a" nine ItatSSSS from 4ample 

Figure 12 

Final Placement of Narrative Statements 

Satisfaction of Result 
LOW HIGH 



HIGH 



Relative 
Importance 




LOW 



By portraying these statements on the two dimensional space, you can see that the first 
priority for goal setting will be those statements that have low satisfaction and high 

f^ 1 rt e a n mP % t if n ^- SeC °, nd P norit y could be those of 1™ satisfaction and lower 
importance. The team will want to highlight those statements that describe high 
satisfactjon and high importance. These are the statements that more than likfly 

?m«£? C SChOGl SUCCCSS - h nall y ! hose that are found in the high satisfaction and lower 
importance may want to be tracked for potential impact in the future 



8. DEVELOPING GOALS 



ST l ^ 3Ve beeu drawn attention can be turned to some specific suggestion, 
and deas for improving over the next few years. Here the whole school faculty may he 
involved m suggesting strategies. Again, this brainstorming can occur in the ^ 
group with all ideas entertained and subsequently rated. 

Goal statements focus on the outcome that you hope to achieve in the comine vear The 

S , fiH P Tn n il^ efnSel \ eS X ? dicate the desired level o^performance and willTervVas a 
§e included g improvements. Both long- and short-term targets can 
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guide to planning school improvements. Both long- and short-term targets can 
be included. ° 

The goals, when developed, will also be prioritized. It may be that the school staff 
would desire to work on several goals or few, depending on the level cf effort. 
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Sources of Information 
Attitude Instruments 



7 »n$ a A^ al T | S - ing ? erV i? e ' Attitudes Toward School »nH School Adiustmrnt - OrpriP 
7 and Above. Princeton, New Jersey. 1985. 

This is one of a series of three age focused bibliographies of a number of attitude 
measures that assess areas such as teacher-student relationships and attitudes 
toward various school subjects, school climate, peers and other school concerns. 

^ CSET^st ^valuation Seri es. Los Angeles: Center for the 

c u Tl \ is ♦ ?edeS 0f h f a f ndb o oks by grade level which contain ratings of tests used in 
nnrmiH t Ra * in .S s , are °tf ered on validity, appropriateness, administrative usability, and 
normed technical excellence. Instruments are categorized by school goals. 

JKSfni™ T„ a £i B l lt0n " Kocher i?- B. An Annotated Bihlinpr^, nf Resnurces 

I "i* ' J he ^ ssessi y n t of StudeinP^forniance. Tn T^ e Cognitive. Affective 
and Psychomotor Areas . Boulder, Colorado: Commission on Schools, North Central 
Association of Colleges and Schools. 1985. ^enirai 

Provides a separate section on instruments in such affective areas as: creativity 
values and attitudes. UMUYU '' 

Mitchell James V. (Ed). The Mental Measurement v ftar hnnV Lincoln, Nebraska- 
University of Nebraska Press. 1985. ' 

f .i T c h? MC 2 J 31 Measurement Yearb oo k (MMY) provides a description of tests in many 
lrn^l nC l U ? ] ? g affect, . ve measures. The description includes information on nSm * 
fiS of °-ifI ime re q u p e J. number of forms, and so on. Following the description is a 
listing of references which have used the instrument in research. An assessment of the 
instrument by reviewers. completes the citation. me 

^?iSaSB , pS^^ d), T?Stsin PrintTR Lincoln ' Nebraska: The University of 

Tests in Print provides a complete listing of all published tests including those 
measuring attitudes. Indicates publisher, publishing date and references the reviews in 

PoTtkn^ Laboratory, Test Center, 300 SW 6th Avenue, 

A collection of instruments identified by category. Copies of the test and 

ISESK /f 10n ! U1 l e C f n ^.borrowed for examination. Instruments measuring student 
attitudes toward school, subject matter and self are included in this collection 
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